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ABSTRACT 

A  complex  system  is  considered  in  its  latter  stages  of  development. 
N  mission  trials  have  been  observed,  each  resulting  in  a  success  or  a 
failure.   Each  failure  occurs  in  one  of  k  failure  modes.  For  each 
failure  mode  that  is  observed  action  is  taken  to  attempt  to  correct 
that  type  of  failure.  The  probabilities  of  correcting  the  various 
failure  modes  are  known.  After  corrective  action  is  completed  attempts 
to  estimate  the  current  reliability,  without  further  sampling,  are 
made.  A  brief  historical  summary  of  this  problem  to  date  is  given. 

Justification  for  assuming  a  prior  distribution  on  the  failure 
modes  is  discussed  and  the  posterior  distribution  of  the  parameters 
is  developed.  An  intuitive  measure  of  the  current  reliability  is 
stated  and  certain  properties  of  this  random  variable  are  developed. 
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1.   INTRODUCTION 

In  the  latter  stages  o£  development  and  testing  of  a  complex 
system  It  is  reasonable  to  assume  that  a  certain  number  of  mission 
trials  have  been  effected,  and  of  these  some  number  resulted  in  the 
failure  of  the  mission.  An  intuitive  measure  of  the  reliability  of 
the  system  at  this  point  would  be  the  ratio  of  failures  to  the  total 
number  of  tests  conducted.  After  analysis  of  the  failure  data  however, 
it  is  conceivable  that  the  reasons  for  each  failure  of  the  mission 
could  be  detected  and  some  corrective  action  taken  against  this  type 
of  failure.  After  taking  corrective  action  the  natural  step  would  be 
to  continue  testing  and  make  statements  about  the  reliability  of  the 
revised  system  on  the  basis  of  new  data. 

If  the  cost  of  additional  testing  is  high,  if  additional  test  units 
are  not  available,  or  if  time  is  a  prohibitive  factor,  further  testing 
may  not  be  feasible.  At  this  point  Corcoran,  Weingarten  and  Zehoa  [ l] 
pose  the  following  problen.  :  "Assuming  that  we  have  confidence  in  our 
knowledge  of  the  effectiveness  of  the  contemplated  corrective  action 
which  may  be  taken  on  observed  failure  modes,  how  should  we  use  the 
results  of  the  first  N  tests  to  draw  inferences  about  the  current  reli- 
ability?" The  problem  is  specifically  structured  in  this  mannei .  Let 
N  tests  be  conducted.   Each  of  the  tests  results  either  in  a  successful 
performance  of  the  mission  or  in  a  failure.   Each  failure  results  from 
a  failure  of  one  or  k  possible  modes.   The  probability  of  a  successful 

mission  is  q  ,  the  probability  of  a  mission  failing  by  the  i   failure 
o 

mode  is  q.  where  i  ranges  from  one  to  k.  The  q's  themselves  are 
unknown;  however,  since  each  trial  must  result  in  a  success  of  some 


type  of  failure  it  may  be  noted  that 

k 


Y 


q^-l. 


Similarly  if  we  let  N.  be  the  number  of  events  of  the  i^  type  observed 

where  N  is  the  number  of  successful  missions  then 
o 


k 


Nj^  =  N 


1  =  0 


It  is  also  assumed  that  there  is  a  known  conditional  probability  a.  of 
correcting  the  i'  failure  mode  given  that  it  occurs. 

Based  on  the  above  formulation  Corcoran,  Weingarten,  and  Zehna  [l] 
define  the  following  random  variable  as  a  measure  of  current  reliability; 


,  0  if  N  -  0 
p*  =  q  +  >   y  q    where  y  =    <       i 
o   Z^   1  ^         i 

i  =  1  a   if  N  >  0 

i     i 


This  is  stated  to  be  an  intuitive  measure  of  the  reliability  since  it 
adds  a  weighted  amount  of  the  failure  probability  of  each  observed 
failure  mode  to  the  initial  reliability.  The  expected  value  of  p*  may 
be  computed  and  is  referred  to  as  the  "mean  reliability."   This  quantity 
is  shown  to  be: 

k 

E[p*]  =  q^  +1  a   q.  [1  -  (1-q.)  ] 
i  =  1 

Since  p*  is  a  random  variable  it  is  customarily  not  estimated.   However, 
the  variance  of  p*  tends  to  zero  as  N  tends  to  infinity;  therefore  any 
estimate  of  E[p*]  can  be  said  to  asymptotically  estimate  p*.  The  above 
authors  postulate  seven  estimators  of  E[p*]  and  discuss  their  relative 


merits  £rom  a  standpoint  of  bias.  The  last  two  estimators >  quoted 
here  £or  convenience,  are  conservative  (underestimate  E[p*])  and  are 
asymptotically  unbiased.  The  last  estimator,  p^,  is  the  more  con- 
servative of  the  two  but  is  also  consistent  for  E[p*]. 


N    ^    N 

o   \      1 


p  =  —  +  /  z .  —     where  z  ~  -{ 
6   N    ^  ^  N  i 

i=l 


N    ^    (N^  -  1) 

p  =  —  +  ,  Yi  where  y 

i=l 


a.   if  N  >  1 
1      i 


otherwise 


a   if  N  >  0 
i      i 


0   if  N  =  0 
1 


The  bias  for  estimator  p  is  shown  not  to  exceed  .01  for  an  N  of  25 

6 

and  a  q  as  large  as  one  third. 
o 

Larson  [3]  considers  the  conditional  distribution  of  the  reliability 

(conditioned  on  the  outcome  of  the  test)  and  demonstrates  its  probability 

mass  function.  Unfortunately  while  the  mass  function  is  known,  the 

actual  values  the  random  variables  take  on  are  unknown  since  they  are 

functions  of  the  q.'s.  A  functional  lower  bound  on  the  true  reliability 

1 

is  shown  to  be: 

P[Z  ^  f|A]  ^  P  [g  ^  f  |a]   P[z  ^  g|A] 
m 

where  the  conditioning  event  A  is  the  event  that  N,>0,'*',N  >  0,  f  is 

a  function  of  the  observable  random  variables  and  g  is  some  function  of 

the  unknown  parameters.   P  [g  ^  f |a]  is  a  conditional  multinomial 

m 

probability  statement  and  P[z  ^  glA]  is  a  statement  from  the  distribution 
of  true  reliability  conditioned  on  sample  results.  The  expression 
P[z  ^  gjA]  can  be  evaluated  j:or  a  certain  class  of  g  functions  ;  thus  a 


Larson,  H.  J.,  Conditional  Distribution  of  True  Reliability  after 
Corrective  Action  (US  Naval  Postgraduate  School.  Technical  Report/Research 
Paper  No.  61,  1966)  p.  10. 
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lower  bound  on  the  reliability  can  be  obtained  if  the  appropriate 
conditional  multinomial  statement  can  be  derived. 

This  approach  has  been  considered  by  the  present  investigator  but 
abandoned  due  to  the  compounding  complexity  in  the  probability  state- 
ments. The  class  of  functions  of  the  parameters  (q, 's)  is  restrictive 
since  the  P[z  ^  gJA]  must  be  capable  of  evaluation.   No  suitable 
functions  of  the  observable  random  variables  have  been  found  that  lead 
to  direct  evaluation  of  the  multinomial  statement.  The  conditional 
distribution  of  the  sample  can  be  obtained  but  it  becomes  exceedingly 
complex  as  the  number  of  failure  modes  increases.  As  an  example  if  we 
consider  only  three  modes  of  failure  (N  ,N  and  N  )  and  the  conditioning 
event  A  =  {n  >  0.  U^   0,  N  =  O]  then  the  conditional  probability  is 
as  follows: 

P[Nq=  a,    N     =  b,   N  =  N-(a+b)|A] 

,        .       b       N-(a+b) 
N'  qp    qi    ^2 

a!    b!    [N-(a+b)]:    [(q  +q  +q  )%  ^   -(q  +q  )       .(q  +q  )    ] 

oi^         o  ol  o2 


i 


for 


lo 


0  <  a  <  N-2 
<  b  <  N-a 


^  otherwise 

It  would  seem  that  any  direct  attempt  to  derive  the  distribution  of 

some  function  of  the  N  's  is  hopeless.   Even  if  the  distribution  of 

1 

the  multinomial  statement  can  be  derived  for  some  class  of  f  and  g 
functions  there  is  no  guarantee  that  these  choices  of  functions  will 
produce  a  useful  bound  on  the  reliability.  The  right  hand  side  of  the 
confidence  interval  statement  is  multiplicative  and  hence  both 
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P  [g  ^  f  |a]  and  P[z  ^  gjA]  must  be  capable  of  simultaneously  yielding 
m 

high  numerical  values  at  the  sample  point.  This  of  course  places 
further  restrictions  on  the  class  of  functions  available. 


2.   BAYESIAN  VIEWPOINT 

In  both  previously  cited  works  [l,  3]  the  probabilities  of  failure 
for  each  of  the  various  modes  are  considered  unknown  parameters.   In 
certain  cases  it  may  be  feasible  to  assume  a  prior  distribution  on  the 
failure  modes  themselves.  As  a  specific  example  if  the  system  consists 
of  k  components  in  logical  series  one  failure  mode  may  be  associated 
with  each  component.   Since  earlier  developmental  history  should  be 
available  on  each  con^)onent  it  is  reasonable  to  assume  that  something 
is  known  about  the  reliability  of  each.   On  the  other  hand  if  each  mode 
of  failure  is  to  be  some  type  of  failure  (electrical,  mechanical,  etc.), 
it  still  may  be  reasonable  to  assume  that  there  exists  some  prior 
knowledge  of  these  failure  rates. 

In  considering  priors  in  general  there  are  several  requirements 
that  must  be  met.  The  marginal  range  of  each  of  the  random  variables 
must  be  the  interval  zero  to  one.   Each  of  the  component  reliabilities 
will  be  close  to  one;  hence  the  distribution  chosen  for  a  failure  mode 
must  be  capable  of  lumping  a  good  percentage  of  its  probability  near 
zero.  The  prior  should  lead  to  easy  computation  if  possible  or  at 
least  be  tractable. 

Three  foirms  of  prior  distributions  were  considered. 


(1)   f  (q  ,q  ,...qk)  = 

0  Q   •  •  •  >  Q, 
^1»  2'      k 


(2) 


'qi>Q2>--V'i''2'---\>   =^ 


G     0  ^  q^^  b  <  1/k   i=l,2,***k 


0     otherwise 


G  q  "q  °^  ...  q,  °^  O^q  ^  b^  1/P  i=l,  •  •  -k 
2^1  ^2      ^      i 


0  otherwise 
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G  q     q     •  •  •  q. 


^0'^1»   ^k  k 


where  ^ 


In  all  three  cases  q  represents  the  probability  of  a  successful  mission 

o 

and  q  represents  the  probability  of  the  i   failure  mode  as  before, 
i 

The  G  's  are  appropriate  constants. 

The  first  two  priors  assume  independence  between  the  various 
failure  modes.  Unfortunately  the  posterior  for  each  of  these  distri- 
butions is  difficult  to  demonstrate.  The  k  fold  integral  appearing 
in  the  denominator  of  each  posterior  is  non-integrable  and  numerical 
techniques  would  have  to  be  resorted  to  if  it  were  to  be  evaluated. 
This  was  not  deemed  worthwhile  since  the  third  form  of  the  prior  is 
actually  a  more  general  representation  than  the  first  two.  It  is  true 
that  (3)  disallows  independence  between  failure  modes  but  no  strong 
argument  can  be  made  for  this  independence.  The  last  prior  will  be 
discussed  more  thoroughly  and  developed  in  the  next  section. 
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3.   PRIOR  DISTRIBUTION  OF  COMPONEOT  FAILURES 

I£  we  consider  a  series  of  N  tests  as  before  with  q  as  the 

o 

probability  of  a  success  on  any  given  trial  and  q  ,  i»l,2,***k,  as  the 

i 

probability  of  a  failure  by  the  i^^  failure  mode,  then  the  probability 
of  observing  N  successes  and  N.  failures,  1=1,2, '''k,  in  the  respective 
failure  modes  will  follow  the  multinomial  probability  law. 

Thus, 

r  I  1  Nl       N^   Ni       \ 

P[n  ,N  ,...N  q  ,q,,.--qj  =  "R "  q^  °  q,    ...  q, 

ol     ko-*-     "^      nNl    °    •'•       ^ 

l»o 


N^  =  0,1,2,-*'N      l^^i  ""  ^ 

i"o 

Raiffa  and  Schlaifer^  suggest  using  a  prior  of  the  same  functional 
form  as  the  distribution  of  the  sample.  This  procedure  leads  to  prior 
(3)  depicted  in  the  last  section.  The  advantages  of  this  choice  for  a 
prior  will  become  apparent  in  the  succeeding  development. 
Thus, 


^-1   mj^-1      J\"^ 
p[qo.qi---qi^]  =  G  q^   q^    ...q^^ 


m 
o 


k 

where  '  q.  =  1    q  ^  0 

t-  1         i 

i=o 
shall  be  the  chosen  prior.  Making  use  of  the  usual  fact  that  a  density 

Integrated  over  its  range  must  equal  one  allows  us  to  evaluate  6. 


"Tlaiffa,  H.  and  Schlaifer,  R. ,  Applied  Statistical  Decision  Theory 
(Boston:  Graduate  School  of  Business  Administration  Harvard  University, 
1961)  p.  47-49. 
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Hence 

1     k 


ra-,  - 1  m   "1 

r   r  ^-^ 

=    . . .    q     .  .  .  q        dq  . . .  dq 

J     J    1  k-1      ^1 


k-1 


\    Vi  ^-^ 


k       k 


r-    m  -1   m  -1 

,    i=i     (1  -     q.)  °     q,         dq 


q  i=l 

k=o 


q 

k 

Now  iettxug    X  =  j^-, 

i=l 
^    r»      "     nJi,"*™  -  1  in  - 1        "k  i 

^1  \-l  i=^ 


1    in  -1         ra  -i- 
f      k  ° 

'  J    ^     (1  ^  x^)      dx 


k 

q 

k=o 


It  may  be  noted  that  the  last  integral  in  the  above  expression  is  just 
a  Beta  integral  with  parameters  m  and  m     integrated  over  its  range. 

Hence: 


}     \-l  ™o"^ 


I  X      (1  -  X  )     =  B(m  ,  m  ) 
J   k  k  k   o 
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By  a   continued   iteration  of   tiie  above  procedure   it  may  be  shown  that; 


-  =  B(in       tn  )    B(in        ,   ra    i-m  )   B(nj        ,   m  -Hn, +nj       ) 
G  k'      o'      ^   k-1       o     k  k-2       o     k     k-L 


B(m,  ,   m  +m,  +in       +   •  •  •   m  ) 
L        o     »■     k-l  2 


Noting   that 


B(m   ,   m  )    =  ^ — 

^        °  r(m  -hn  ) 

k     o' 


_  \^ 

r(ni     +  ID  +   •  •  •   m,  )                          •__ 

o          1  k'                   _      J--0 
G   = 


<I"J 


r(m^)  r(m^)  •••  r(m^)  n    r  (o  ) 


Hence   the   complete  prior   is   given  by: 

r  ^       ^ 

^  Vz_-"i  y  m   .1       m   -1  m  -1 

o*    1'  ^k  n       r   (m  ) 

i=o  i 


k 

where  V^     =   ^  ^^d  q.    ^  0     i=  O,!,'"    k 


i=o   ^ 


Several  properties  of  this  prior  will  be  needed  at  a  later  point;  for 
convenience  they  will  be  derived  or  substantiated  at  this  time. 

(a)  Marginal  Distribution  of  the  q  's 

i 
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Consider  ^ 

^.^     i  -^  r  p       m-l       m-l  ™i,'^ 

Qik  oA  *"2k 

1  n  r  (m  )  ^2     "^k 

i 
i=o 


Iterating  this  integral  as  in  the  previous  case; 
k 


y 


I      (a  \    =     ^^ B(m  ,  m  )•••  B(m  ,  m     +  m  +'"+  m  Ha  ) 

Q  ^^i^  k  ko       2ok43 

1         n   r  (n,.) 
i=o 


°^i-^  ,,   ,°'o-»™k+  •••  ^-^2  "  ^ 

X  q^^    (1-q  ) 


Letting    m  ■  m 
i=o 


f   (q  )  =  — q   '    (1  -  q  )      ^ 

Q   ^    r  (m,)  r  (m  -  m  )       ^ 


1       *  ^""l' 


B(m  ,  m  -  m.) 


m  "1        m  -  m  -1 

q,    (1  -  q,)         0  ^  q  ^  1 

11  ^1 


=   0  otherwise 

"  By  symmetry  arguments  the  i   marginal  is  of  the  same  form, 
therefore; 
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ID  -1        m  -  m   -  1 

f   (q)  =  1 q  i    (1  -  q) 

^      B(in  ,  m  -  m.) 


f  (q,  m  ,  m  -  m  )  0  ^  q  ^  I 

B     i       i 


Thus  the  marginals  of  the  prior  are  Beta  distributed  with  the  appropriate 
parameters  as  shown.   For  this  reason  and  for  convenience  in  notation 
the  prior  itself  will  be  referred  to  as  a  multivariate  Beta. 


(b)   Expected  Value  of  the  Q  's  with  Respect  to  the  Prior  Marginals 

1 


E(Q.)  =  ,  q  f   (q)  dq 

i    'J     Q 
o     i 


1 

p  m,        m-m  -1 

■^7 ^ r J  q  Ml  -  q)    ^    dq 

B(m  ,  m  -  m.) 

i       ^      o 


Hence 

B(m+  1,  m  -m) 

i  i        m 


E(Q.)  =  =  • 

1    B(m.,m-m)  m 


(c)   Variance  of  the  Q  's 


i 


9           1  f   m.+l       m  -  m.-l 

E(Q  "■)    = : J   q  ^   (1  -  q)         dq 


i  B(m.,m-m) 

1       i 


o 


m^  (m^  +  1) 


m(l  +  m) 
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Thus 


Var(Q  )  =  E(Q  ^)  -  B  (Q  ) 

i       i        i 


m ,  (m  -  m  ) 

^ i 


m  (1  +  m) 


(d)   Joint  Density  of  Q  ,  Q 

i       J 


LJjni. 


f       (q  »  q  )  = q 

Q.Q.      i       j  r   (m.)    r  (m.)   r  (m-m  -m.)      i 


m  -1       m.-l  m-m^-m  -1 

q.  ^    (i-q.-q.) 
J  i    J 


i  J  i 


q  ^   0 


(e)      Covariance  of  Q   ,   Q 

i   j 


r(m) 


E(Q.Q  )  =  

J    r  (m.)  r  (m  )  r  (m-m  -m.)    q      q 
1      j        i  J     i=o    j 


1   1-q. 

J     J        q.      q, 


^       J 


Let 


(1  -  q  -q  )      J   dq  dq 

1  j  i   j 


X  = 


1  -  q. 


Then  integrating  as  before 


m 


m 


E(Q  Q.)  = 


i  J 


i  J     m  (1  +  m) 
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And 


Gov   (Q.Q.)    =  E(Q.Q  )    -   E(Q.)    E(Q  ) 


1   J 


»i"j 


m   (1  +  m) 


m 


m.m. 

_Lj. 


m'^(l  +  m) 
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4.      POSTERIOR  DISTRIBUTION  OF  THE  PARAMETERS 

In  the  process  described  previously  the  distribution  o£  the  sample 
was  given  by 

N'  ^o       ^^  \ 

P[N^,N^,'..Njq^...q^]    =     ^^,    ...    '^^.  q^  °   q^        '••    q^ 

Utilizing  the  prior  described  ia  section  three  and  applying  Bayes  rule 

we  get; 

N„+m  -1    Ni-hn  -1       N  +n>  "^ 
°   O        ^1  k   k 


o 

pU  •••q,jN„,...N,] 


j  •••]  \  '"    \  1^1-  ^^i^       dq^...dq^ 

q,     q^  i=l 


Noting  the  similarity  between  this  integral  and  that  previously  seen 
in  section  three  gives 


N  +m  -1     N,-Hn  -1 
r  (N  +  m) o  °       ^     ^ 

p[q  ...a  In  ,...N,  ]  =  „       ^  ,    ,   q     •••q, 

o    Tc'  o*    k    r  (N  -hn  )-*-r  (N, +m, )     o  k 

o  o       k  k 


where  N  =  Y  N.   and  m  =   m.    as  before. 


Except  for  suitable  changes  in  parameters  this  distribution  can  be 
recognized  as  the  multivariate  Beta  of  the  previous  section.  This 
facility  in  handling  the  posterior  is,  of  course,  one  of  the  reasons 
for  choosing  this  particular  distribution  for  a  prior.   Of  course  a 
prior  must  meet  more  requirements  than  just  facility  in  use.  The 
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multivariate  Beta  in  question  does  satisfy  the  intuitive  demands  set 
forth  earlier.  A  logical  method  for  selecting  the  parameters  of  the 
prior  (m  's)  will  be  given  in  Appendix  I.  The  assumption  of  this  prior 
is  equivalent  to  a  form  of  "linear  squashing"  described  by  Good   in  his 
work  on  the  estimation  of  probabilities. 

As  has  been  noted  above  the  posterior  distribution  is  itself  a 
Beta,  hence  the  properties  of  the  posterior  may  be  stated  by  analogy 
from  the  previous  results.  For  future  convenience  these  properties 
will  be  listed  below. 


(a)   Posterior  Marginal 


N.-hn.-l     N-Hn-(N^-hn.)-l 


f  (q|N  .-••N.)  =~         ;:    ^~   q     (1-q) 

Q,    o     k    B(N.-Hii  ,  N+m  -  (N,+m.)) 
1  11         i  1 


(b)      Marginal  Mean 

\^"i 

E(Q  In  ,...n,)  = 

i     o  K  N+m 


(c)      Marginal  Variance 

(N-Hd)    (N  -hn,)    -    (N.+  m  ) 
Var(Q    |n   »---N)   = — 

°  (N  +  m)^   (1  +  N  +  m) 


(d)  Conditional  Covariance  of  Q  ,  Q 

i   J 

(N.  -hn.)  (Nj  +  m^) 

Cov(Q  qJn  ,*-*N,)  =  - 


2 


i  J   o  (N  +m)2  (1  +  N  +  m) 


1 
Good,  I.  J.,  The  Estimation  of  Probabilities,  an  Essay  on  Modern 

Bayesian  Methods  (Cambridge:  Research  Monograph  No.  30,  The  M. I.T.  Press, 

1965)  p.  24. 
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5.  RELIABILITY 

Corcoran,  Weingarten  and  Zehna  [l]  define  the  current  measure  of 
reliability,  p*,  that  was  stated  In  section  one  of  this  paper.  The 
estimation  problem  is  considered  to  have  taken  place  prior  to  the 
observation  of  the  N  tests.  Averaging  over  all  possible  outcomes  of 
the  N  tests  to  produce  the  "mean  reliability"  is  justified  on  this  basis. 
Larson  [3]  regards  this  of  interest  in  the  early  phases  of  development 
before  testing  can  take  place  but  points  out  that  the  final  reliability 
is  actually  a  function  of  the  outcomes  of  the  N  tests.  This  is  true 
because  whether  or  not  a  corrective  attempt  is  made  depends  on  observing 
the  given  failure  mode.  For  this  reason  he  developes  the  conditional 
distribution  of  true  reliability  (conditioned  on  the  outcomes  of  the 
N  tests)  and  shows  that  p*  is  in  fact  the  mean  of  this  conditional 
distribution.  This  poses  the  question  of  how  to  properly  interpret  E(p*) 
Since  p*  is  the  mean  of  the  conditional  reliability  it  would  seem 
unreasonable  to  average  over  all  possible  outcomes  of  the  N  tests  (some 
of  which  are  known  not  to  have  occurred)  to  obtain  E(p*).  Larson 
considers  it  more  reasonable  to  attempt  to  estimate  p*  rather  than  E(p*). 

There  would  seem  to  be  other  avenues  of  approach  open.  Consider 
the  original  question  of  attempting  to  make  probability  statements  about 
a  complex  system  after  some  period  of  testing  and  applying  corrective 
action.  The  discreteness  of  the  conditional  reliability  function  could 
be  interpreted  as  an  anomaly  arising  from  simplification  in  the  logical 
statement  of  the  problem.  The  uncertainty  in  the  actual  reliability 
arises  from  two  sources:   the  uncertainty  in  the  failure  modes  themselves 
and  the  uncertainty  of  correcting  a  type  of  failure  if  it  occurs.   In 
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some  cases  it  may  be  feasible  to  treat  the  uncertainty  in  the  failure 

modes  by  assuming  a  prior  distribution  on  the  q  's.   Partial  justi- 

i 

fication  for  this  procedure  was  given  in  section  two. 

It  does  appear  attractive  to  treat  the  reliability  as  conditioned 

on  the  outcomes  of  the  N  tests.  At  least  at  that  point  in  time  we  know 

which  modes  of  failure  it  is  possible  to  remove.  With  the  above 

considerations  in  mind  the  following  scheme  is  proposed.  Let  N  tests 

be  conducted,  the  results  of  which  are  N  successes  and  N.  failures  in 

o  i 

the  respective  failure  modes,  i  "  1,2,***  k.  The  probability  of  a 

success  is  q  ,  the  probability  of  the  failure  of  the  i   mode  is  q  , 
o  i 

where 

k  k 

V  q  =  1  ')  N  =  N 

^  i  ^  i 


i-o 


1=0 


The  maximum  number  of  failure  modes  that  can  occur  is  k;  it  is  not 

necessary  that  each  mode  be  observed  however,  and  a  sample  will  in 

general  demonstrate  less  than  k  failure  types.   If  we  let  a  be  the 

i 

probability  of  correcting  the  i^  failure  mode  given  that  it  is  observed 
and  b.  be  the  unconditional  probability  of  correcting  each  failure  mode 


it  follows  that 


0    N.  =  0 

1 


The  following  is  stated  as  an  intuitive  measure  of  the  reliability 
after  corrective  action.  This  is  of  course  the  same  measure  defined 
by  Corcoran,  Weingarten  and  Zehna  [ 1] .  The  interpretation  given  to 
it  here,  however,  differs  from  that  of  the  above  paper.  The  actual 
sampling  is  considered  to  have  taken  place  and  R  is  conditioned  on  this 
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outcome   through  the  b    's, 

i 


R  =  q    +y  b.q. 

O  /Li         XX 

i»l 


k  k 


=   1  +)    (b.    -   1)    q. 

^       i  1 

i=l 

If  we  are  willing  to  assume  a  distribution  on  the  q  's  then  R  is 

i 

a  function  of  random  variables  and  is  hence  itself  a  random  variable. 
The  remainder  of  this  study  will  be  devoted  to  the  development  of  the 
properties  of  this  measure  of  reliability  with  respect  to  the  posterior 
distribution  developed  in  section  four,  R  is  t  e  weighted  sum  of 
dependent  Beta  distributed  random  variables.  It  is  not  possible  to 
obtain  the  convolution  of  independent  Beta's*  hence  there  is  little  or 
no  hope  of  deriving  the  distribution  of  R. 
Now  , 

E(R)  =  1  +  V  (b.  -  1)  E(q  ) 

i=l 

Noting  from  section  four 
N.  +  m. 


E(q .) 


X      1 


N  +  m 


-k         N,  +  m. 
E(R)  =  1  +  ^  (b.-l) 


i=l 


N  +  m 
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Using  the  variance  and  covariance  formulation  developed  in  section  four, 
let 

(N.  +  in.)(N.  +  m.) 


a 


1 "   J    J 

ij  2 

(N  +  m)   (N  +  m  +  1) 


2 

(N  -fin)  (N  +  m.)-(N  +m  ) 

a   =  1 i i 

ii       (N  I-  m)   (N  +  m  +  1) 


Now  let  V  equal  the  matrix 

II  a  II      '■  ^'^'  •••  ^ 
^j       j  «=  1,2,  ...  k 

and  a  equal  the  vector 

(b^-1,  b^-l,  •••,  bj^-1) 

Then  the  variance  of  R  is  the  quadratic  form 

Var(R)  =  a'  V  a 

Thus  although  the  distribution  of  R  cannot  be  shown  its  mean  and 

variance  are  known.  These  parameters  are  functions  of  the  N  's  and 

i 

hence  are  uniquely  determined  for  each  sample  point.   In  an  informal 
sense  the  mean  and  variance  of  a  random  variable  can  be  said  to  "estimate" 
the  random  variable  and  hence  E(R)  provides  some  indication  of  the 
corrected  value  of  the  reliability.   In  the  above  case  it  may  be  noted 
that  the  variance  of  R  tends  to  zero  as  N  tends  to  infinity;  hence  the 
density  of  R  "lumps"  at  the  mean  as  N  increases.   In  this  sense  E(R) 
may  be  said  to  asymptotically  estimate  R  as  N  increases.  This  fact  may 
be  of  little  use  however  since  the  N's  of  interest  can  be  expected  to 
be  small. 
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It  is  feasible  that  the  higher  moments  of  the  distribution  could 
be  obtained.  While  these  moments  may  be  complex  they  should  be  functions 
of  the  N's  and  hence  capable  of  being  evaluated.   Obtaining  all  of  the 
moments  would  of  course  be  equivalent  to  obtaining  the  actual  distri- 
bution. 

One  last  avenue  of  approach  may  be  worthy  of  mention.   It  was 
initially  hoped  that  the  formulation  in  this  study  would  lead  to  the 
ability  to  make  confidence  interval  statements  about  the  reliability. 
Except  for  the  loose  bound  obtainable  through  Chebychev's  inequality 
this  has  not  been  realized.  The  question  of  the  existence  of  some 
limit  theorem  has  not  been  thoroughly  investigated.  This  does  not 
appear  promising  but  it  may  warrant  some  further  consideration. 
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APPENDIX  I 
SELECTION  OP  PRIOR  PARAMETERS 


One  possible  method  of  selecting  the  parameters  o£  a  prior 
distribution  would  be  to  fit  a  set  of  prior  means  and  variances  to 
the  distribution.  With  the  multivariate  Beta  in  question  however 
there  are  insufficient  parameters  (k  +  1)  to  do  this.  The  following 
method  suggested  by  Silver  is  given. 

We  use  the  last  k  parameters  to  fit  the  means,  then  the  remaining 
parameter,  m  ,  is  used  to  obtain  a  least  squares  fit  to  the  prior 


O 

variances. 


Let 


(1)      m  =  >  m 

^  i 


V 

L 

i=o 


Then 

m 

E(q  )  =  i  =  l,2,«'*k 

i     ni 

m,(m  -  m.) 
(2)      Var(q  )  =  — ^^ i  =  l,2,.«-k 

^     m  (1  +  m) 


Substituting  equation  (1)  into  equation  (2) 


E(q.)  [1  -  E  (q  )  ] 
1  i 


Var(q.)  = 


m  +  1 


Let  Var(q  )  be  the  prior  estimated  variance  of  q  , 


1 
Silver,  E.  A.,  Markovian  Decisions  Processes  with  Uncertain 

Transition  Probabilities  or  Rewards  (M.I.T.,  Interim  Technical 

Report  No.  1,  1963)  Appendix  C,  pp.  177-179. 
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Hence  we  want  to  choose  m  to  minimize 

k 
SS  =^     (Var(q.)    -  Var(q^))^ 

i-1 


k 

SS  »  ^      Var(q  ) 


ECqp    [1   -  E(qp] 


ra  +  1 


Setting  d(SS)/dm  equal  to  zero  we  get  the  following  for  a  least  squares 
value  of  m  equal  to  m. 
k 

V   r  -.2    r  -.2 

zL,[E(q  )]      [1   -   E(q)] 
i-1  i  ^ 


m  =         k 


-  1 


)      Var(q  )    E(q  )    [l   -   E(q  )] 
i=l 


and  hence 


m     =  m  E(q  ) 
i  i 


i  =  1,2,--'   k 
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